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ABSTRACT 

We analyze all the possible continuous horizontal gauge groups Gh in rela¬ 
tion with their possibility to explain m;, <<mt. We assume that the only 
effective fermionic degrees of freedom correspond to the known fermions but 
allow the possibility of adding a right handed neutrino to each family. We 
assume that the Higgs fields which generate masses for these fermions, trough 
renormalizable Yukawa couplings, transform as an irreducible representation 
of SU(3)c®SU(2)j;,(8)U(l)y(8)G//. Under these assumptions we find two U(l)jy 
or U(l)jyi 0 U(l)iy 2 models free of anomalies and able to guarantee that only 
the top has a renormalizable mass-generating Yukawa coupling. 
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1 Introduction. 

The pattern of fermion masses, their mixing, and the family replica¬ 
tion, remain as the most ontstanding problems of nowadays particle 
physics. The snccessfnl Standard Model (SM) based on the gange 
gronp SU(3)c®SU(2)L(8)U(l)y can tolerate, bnt not explain the ex¬ 
perimental results. Two main features that a consistent family the¬ 
ory should provide are 

(i) -Within each charge sector, the masses increase with family by 
large factors 

rriu << rric << rrit, rrid « rris « rrih, rrie « << 171^, 

(ii) -Within each family, the masses are quite different. In particular, 
for the third family we have 


mb << mt. 

The horizontal survival hypothesis [|^ was invented in order to cope 
with this hierarchy without putting it by hand in the Yukawa cou¬ 
plings. According to this hypothesis, a certain symmetry should 
guarantee that at the unification scale all the Yukawa terms, with 
Yukawa couplings ?////, where f and f are flavor labels, vanish except 
for those corresponding to the third family for which yu ~ Vbb ~ Vtt- 
A different starting point was introduced in Ref. , under the name 
of modihed survival hypothesis, demanding that all the Yukawa 
terms vanish at the unification scale except the diagonal one of the 
top quark, 

In this paper we classify the continuous anomaly free horizon¬ 
tal symmetries that lead to the modified survival hypothesis. We 
take the number of families to be three and extend the SM group 
to SU(3)c®SU(2)j;,®U(l)y(8)G// and allow Gh to be any of the sub¬ 
groups of the most general family symmetry which commutes with 
SU(3)c®SU(2)i(8)U(l)y. We keep the number of ingredients and 
parameters down to the minimum possible assuming that the model 
does not contain exotic fermions, with the only exception of a pos¬ 
sible right-handed neutrino state for each family, and assuming 
that the Higgs helds transform as an irreducible representation of 
SU(3),^SU(2)i®U(l)y®GH 

The most general family symmetry which commutes with SU(3)c<8)SU(2 )^ 

is 

G =U(3)q®U(3)„®U(3)rf®U(3)i(g)U(3)e®U(3)^ 
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where each factor is defined in the space of vectors rj = {t]i, t ]2 rj^) 
with rj = q, u, d, I, e, or z/, 


q = 


Cl 

^ 1 U = d 

/ OiL 


d^ 1 



U = U 


Li 


and where c denotes a charge conjugated field and a is a color index 
which will not be displayed in what follows. In what follows we 
also omit the helicity index L. Each U(3)^ =SU(3),,0U(1)^ contains 
a family independent subgroup U(l)^ and the SM U(l)y factor is 
contained in U(l)g®U(l)u®U(l)d®U(l)i®U(l)e0U(l)iy. 


Obviously G is not itself a candidate for a gauged family symme¬ 
try since none of its SU(3),, factors, with just one triplet of fermions, 
is anomaly free. In what follows we analyze all the continuous sub¬ 
groups Gh of G which are anomaly free and which allow a (mass 
generating) Yukawa coupling only for the top quark. By mass gen¬ 
erating Yukawa coupling we mean the coupling to fermions of the 
Higgs that develops an SU(2)i®U(l)y breaking vacuum expectation 
value (VEV). 

In section 2 we review and extend our previous results 0 for the 
simplest form of Gh-, namely Gh = U(l)//. In the following sections 
we increase the complexity of Gh- We hnd two models which satisfy 
our conditions. They can be seen either as U(l)// models or as 
U(1 )hiG)U( 1)//2 models. In section 9 we make a brief analysis of 
the phenomenological implications of these two models. In section 
10 we summarize our conclusions. 


2 SU(3)c0SU(2)i0U(l)y0U(l)iy as an anomaly- 
free model. 

A gauge theory is renormalizable if it is free of anomalies [^]. For this 
particular model only the gravitational[§] and chiral anomalies @] are 
present^. We demand cancellation of these anomalies by the power 
counting method. (The alternative of canceling the anomalies by the 
Green-Schwarz mechanism]^] requires additional assumptions at the 
string theory level |§].) 

There are two different ways of canceling the anomalies. One is 
demanding cancellation of the anomalies within each family and the 
other one is canceling the anomalies among families. 

^The inclusion of gravitational constramts has successfully lead to the rederivation of some 
aspects of the Standard Model. See Re. g and references quoted therein. 
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2.1 Cancellation of anomalies within each family. 

Assuming that there are no right-handed neutrinos, using the U(l) 
charges in Table la, and demanding freedom from chiral anoma¬ 
lies for SU(3)c®SU(2)i®U(l)y®U(l)H, we get the following set of 
equations {i = 1,2,3) for the U(l)/f hypercharges: 


[SU(2)i]"C/(1)h : 

Yii -|- 3Ygi — 0, 

(1) 

|SU(3)J"C/(1)« : 

2Ygi -j- Yui -|- Ydi = 0, 

(2) 

[r/(l),f (7(1)„ : 

2 16 4 

2Yii + 4Yei + gYgi -h ~^Yui + '^Ydi = 0, 

( 3 ) 

f/(l)y|C/(l)H|2 : 


(4) 

[grav]^t;(l)H : 

2Yii Yei 3{2Yqi -\- Yui + Ydi) = 0, 

( 5 ) 

^(1)81“ : 


(6) 


For a Higgs held with U(1 )h charge Y^, a Yukawa coupling for 
the top quark is allowed if 


Y,3 + Y„3 = (7) 

whereas a bottom quark coupling is forbidden if 

n3 + Y,3^->0 = V- (8) 

Eqs. 1^ and ^ are however in contradiction with Eq. ^ Therefore, 
if a top quark mass arises at tree level, a bottom mass arises as well 
at the same level. 

Including right handed neutrinos vf does not change this conclu¬ 
sion since Eq. 2 stays valid. The only changes are in Eqs. 5 and 6 
which are now replaced by 


[gravj^f/(1 )h : ‘^Yu -|- -\- 3(21^^ -|- Y^i -\- Ydj) — 0, (9) 

1I7(1)„]=> : 21^1 + Kj + 6K4 + + 3y| + y? = 0. (10) 

2.2 Cancellation of anomalies among families. 

If the U(l)i(f anomalies are canceled by an interplay among families, 
Eqs. 1 to 6 should be understood with a sum over i = 1, 2, 3. Eq. 4 
then reads 

E(-ri? + rj + y,i - 2yj. + yj) = o. (ii) 
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A general class of solutions to the new anomaly cancellation equa¬ 
tions which are linear in Yh is characterized by the constraints 

i:r,. = o (12) 

i=l 

for 1 ] = q,u, d, I, e. We will limit ourselves to this type of solutions, 
and within this set we will consider only those for which the Ui and 
k U(l)// hypercharges are hxed to satisfy either 

Yn = 6i = 6, Yi2 = 62 = -6, Yi, = 6s = 0, 

Y^s = S[ = Y, Y^2 = d'=-6', W 3 = 5'=0, (13) 

or any set of relations obtained by a permutation of the indices 
i = 1,2,3. (This guarantees that the ratios of U(l)// hypercharges 
within the set of fermions of a given charge are rational numbers. For 
solutions with irrational numbers see Appendix A.) These solutions 
can be divided into four classes according to the way the cancellation 
occurs in Eq. 0 . 

CLASS A Lepton sector independent of quark sector, 
h'ei = Yii = di and Ygi = Y^i = Y^i = 6-,i = 1,2,3. A model 
with a tree-level top quark mass arises if Y^ = Ygi + Y^j for some 
i and j. There are hve different models in this class characterized 
by Y 0 = ±26', ±6' and 0 respectively. Simultaneously a tree-level 
bottom mass arises if there exist family indices k and I for which 
Yqk + ydi = —Y(f,. For example, if Y^ = 26' then i = j = 1 and 
k = I = 2 satisfy both conditions; this is signaled in Table 2 by the 
entries (1,1)„ and (2, 2)d in the Class A column and the 26' row. 
The fact that in Table 2 there is at least one d-type entry for every 
M-type one for all the hve models of Class A means that none of 
them is viable. (This stems from the equality Y^i = Y^i in Class A). 

CLASS B Doublets independent of singles. 

Ygi = Yu = 6i and Y^i = Ydi = Y^i = 6'i,i = 1,2,3. There are nine 
different models in this class characterized hy = 6 ± 6', — (5 ± 
6'), ±d, ±5', and 0 respectively. Again none of these models is 
viable (Ydi = Y^i in Class B also). 

CLASS C Interplay between doublet leptons and singlet quarks. 

Ydi = Yu = 6i and Ygi = Y^i = Y^i = 6'^, i = 1,2,3. There are 
now eleven different models in this class characterized by = 
±26', (5 ± Y, —(6± 6'), ±6, ±Y and 0. As can be seen from Table 
2 , for 6 0, ±(5', ±26', ±35' and d' 7 ^ 0 there are two models in 
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which only one M-type mass and none d-type one develops at tree- 
level. These models are: 

MI . Where the Higgs field has (U(l)y,U(l)iif) hypercharges equal 
to (-1,25'). 

MIL Where the Higgs field has (U(l)y,U(l)H) hypercharges equal 
to (-1,-250- 

The rest of the models in this class are non-viable because a bottom 
quark mass arises at tree level. The U(l)// quantum numbers of the 
Yukawa terms in the models MI and Mil are displayed in Appendix 
B. 

CLASS D Same U(l)/f hypercharge for the whole family. 

This is a particular case of classes A,B, and C above, for which 
5i = S', which in turn implies @] Ygi = Y^i = Y^i = Yu = Y^i = Si. As 
far as the quark mass spectrum is concerned this class is equivalent 
to class A. 

We may include right-handed neutrino fields within the above 
scheme either by setting = —Y ,^2 = S, Yy^ = 0 (or permutations 
of the indices 1,2,3), or by imposing Y^i = 0 (which is one of the 
ingredients for the see-saw mechanism [PI]|] ). 

3 SU(3)c0SU(2)2,0U(l)y0U(l)iji0 U(l)i/2' 

Let us consider first the case where U(l)//i =U(1)'^ and U(1 )h2 =U(1)«. 
There are again two different ways of canceling the anomalies, the 
cancellation within each family, and the cancellation among families. 

3.1 Cancellation of anomalies within each family. 

Without right-handed neutrinos, the only anomaly-free solution cor¬ 
responds to the trivial one Y^=Y^ = 0. Let us see why. 

The [SU(3 )c]2U(1)hl constraint is = 0. The [SU(2)i]2U(l)^ 
constraint is Y^ -|- 3Yg^ = 0, which combined with the previous 
result implies Y^ = 0. Hence, Y^ = 0 as stated. (This result still 
holds when we include right-handed neutrinos which are singlets un¬ 
der SU(2)i and SU(3)c). Now the [SU(3)c]^U(l)^ constraint implies 
Y^- -I- Yf- = 0. The [grav]^U(l)^ constraint implies Y^ -|- 3Y^- -|- 
3Y^- = 0, which combined with the [SU(3)c]^U(l)'^ constraint gives 
Y^ = 0. Now if we combine the last result with the [U(l)'^]^U(l)y 
constraint {Y^f - 2{Y^f + {Y^f = 0, we get Y^~Yui=Y^=Q as 
anticipated above. 
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When we include the right-handed neutrinos we still have = 0 
as commented in the previous paragraph. The anomaly cancellation 
equations for are then given by equations I-1 and P and 0 
with Yu = Yqi = 0. The solution to those equations is Y^= Y^ = 
—Y^ = —YJ^ = Ki, where k* are three arbitrary numbers. Therefore 
a Higgs field with Y^ = % will produce Dirac masses for the top 
and bottom quarks, and for the r and leptons as well. 


3.2 Cancellation of anomalies among families. 

Using the U(l)^ and U(l)^ charges in Table la we get the following 
set of equations to be satished simultaneously: 


[SU( 2 )i] 2 U(l)^(^) : 

[grav] 2 U(l)^(^) : 
[U(1)UR)]3 . 


u(Y,f + 




qi 


) = 0 


li + 


= 0 

- - V / 

:,[(Y,t)2-(Y,f)2]=0 
:,(3Y,i + Y,f) = 0 
:,[3(Yi)3 + (Y,f)3l = 0 


j:^{Y^Y + yi) = o 

E.(3Y« + 4Y« + Y,f) = 0 
E^[{Yir-2(Y^Yr + {YiY]■■ 
E.(i;f + 3Yi + 3Y,f) = 0 

, Qfwii'iS , q(yRY] 


0 

= 0 . 


The mixed anomalies related to U(1)^[U(1)'^]^ and U(1)'^[U(1)'^]^ 
trivially vanish due to the fact that for every SM multiplet one of 
the two hypercharges Y^ or Y^ is always zero (see Table la). 


Contrary to the case with a single U(l)/f factor group, the constraint 
given by eq. ( 0 ). follows fron the above anomaly cancellation eqs. 
Furthermore, the quadratic anomaly cancellation eqs. demand now 
that the case of cancellation of anomalies among doublets be inde¬ 
pendent of the cancellation among singlets. Therefore we set 

= = 5, Y]Yh = -5, = yf-i-if, 


YS, = S[ = S', y,^^sy-s', r« = ij = o, 


= A' 

^ ei ^ di ^ ui ^ 2 ’ 


or any set of relations obtained from them by a permutation of 
the indices i = 1,2,3 (for other solutions see Appendix A). These 
solutions are similar to the solutions in Class B in section 2.2, hence 
the same conclusions follow. 


3.3 U(l)m U(1 )h2 = 

Again, if we demand cancellation of anomalies within each family, 
the linear constraints imply = 0 for all fermions. When 

anomalies are canceled among families the situation is similar to 
that of class A models in the case Gh = U(l)/f. Setting 
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and 


Y^' 


quarks 


= Y 

'I 


quarks 




quarks 


di 


= 5' 


yrleptons _ y^/eptons _ ^ 

we are led again to the conclusion that there are no viable models 
in this case. 

3.4 U(l)m =U(1)'?“% U(l)^,2 =U(l)''h 

Again, nontrivial horizontal hypercharges are compatible with anomaly 
cancellations only when these are realized among families. 

Setting 


■\rque -^que 

^ qi ^ ui 


rr = 


vdl _ _ r 

— ^di — 

we obtain the models MI and Mil of section 2 with = ±25', = 

0. For the Yukawa terms to be invariant under the full Gh = 
U(l)9“®0U(l)'^^ a vanishing entry in the matrices of quantum num¬ 
bers displayed in Appendix B should be obtained without the inter¬ 
play of 5 with 5'. Therefore the only condition that on 5' imposes 
the requirement that an invariant Yukawa term be allowed only for 
the top quark is just Y 7 ^ 0 . 

We close this section by remarking that a glance to Eq. should 
convince the reader that it is not viable to consider additional U(l) 
factors in Gh, Gh = U(l)//i( 8 i U(l)// 2 ® U( 1 )h 3 ® ...That is, there 
is no other way of canceling the U(l)y [U(l)//i]^ anomalies. 

4 SU(3)c0SU(2)i0U(l)r0SU(2)iy. 

All the possible models for this group have been exhaustively ana¬ 
lyzed in Ref.1 11 If. We use here some of their results. The anomaly 
free SY{2)h spectra in the absence of right-handed neutrinos shows 
that from the 9 x 27 possible arrangements of representations in the 
gauge group only 14 satisfy the chiral and global anomaly con¬ 
straints (there is not a gravitational anomaly for SY{2)h, and the 
global anomaly vanishes if the theory contains an even number of 
SU(2)j:^ doubletsj^). These fourteen possible models are presented 
in Eq.3 of Ref. ||TI| and analyzed in Sections. II, III, and in the 
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summary of the tree level results presented in Table IV of the same 
reference. From that Table (which is correct up to minor details) 
we see that none of the possible models is able to produce a tree 
level rank one mass matrix for the up quark sector simultaneously 
with a rank zero mass matrix for the down sector. In more detail 
the situation is the following: 


From Eq. 3 in Ref.|]^ we see that there are only 11 different 
quark arrangements to be considered in the 14 theories enumerated 
(Qi, Qs and Q21 appear twice) where the possible quark SU( 2 )i^ 
representations Qj, i = 1 — 27 are in Table 4a considering that in 
the table all the representations belong to the same horizontal group 
SU(2)j:^. Now, S\J{2)h does not act on the quark helds in Q 21 , hence 
it has for the quark sector the same information than the SM has and 
we ignore it. We also ignore Q 13 since in this arrangement S\J{2)h 
does not act on the up quark sector. Then we should analyze only 
the following SU( 2 )h structures: Qi, Q 4 , Qe, Qs, Qio, Qii, Q12, 
Qi 6 , and Qis. 


Since a mass term for the up quark sector is of the form {(j)^)u'^q, 
and that for the down quark sector is of the form and 

since SU( 2 )j:^ is a (pseudo-) real group, it is obvious that when 
and are in the same representation of 811(2)/^, a Higgs held 0 
which produces a mass matrix for the up sector will produce, via 
(j)^ = —cr 2 L 0 * or (f)^^ = —a' 2 LO' 2 H 4 >*, the same mass matrix for the 
down sector (up to a Yukawa coupling constant). Therefore the 
structures Qi, Q 4 , Qg, Qn, Q 12 and Qig are not viable. We are then 
left only with the structures Qg, Qio and Qig to be analyzed. 


Qi 6 was analyzed in full detail in Ref. ||TI[| . The SU(3)c<8)SU(2)//® 
SU(2)L®U(l)y quantum numbers (QNs) for the quark sector in this 
model are q ~ (3, 2, 2 )i/ 3 ©( 3 ,1, 2 ) 1 / 3 , ~ (3, 2, l)_ 4 / 3 ©( 3 ,1, l)- 4 / 3 , 

~ 3(3,1, 1 ) 2 / 3 - An up quark mass term in Qig has SU(2 )h QNs 
according to the product (2 + 1) x (2 + 1) = 3 + 2{twice) + l{twice). 
Since a down quark mass term has QNs (2 + 1) x 1 = 2 + 1, a 
Higgs held belonging to the representations 1 or 2 of SU(2 )h will 
produce non zero mass matrices for the up and down sectors simul¬ 
taneously. A Higgs held 0^ belonging to the representation 3 of 
SU{2)h generates a mass matrix only for the up quark sector of the 
form {(pi) J2lb=i where each 0*. is an SU(2)£, doublet with 

VEV of the form {xk, 0)^. With all0 the Xk ^ 0 the rank of the up 
quark mass matrix is two, with = rric, which is unphysical ||11|| . 

§At the scale {(pk) SU(2)j:f is aready broken and we cannot use it to orientate (cpk) in the 
H space 
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Hence Qie is not able to explain the known quark mass spectrum. 

Now for Qe, the SU(3)e®SU(2)j/(g)SU(2)L®U(l)y QNs for the 
quark sector are q ~ (3, 2 , 2)1/3 © (3,1, 2)1/3, ~ (3, 2 , l)_4/3 © 

(3,1,1) -4/3, ~ (3, 3, 1 ) 2 / 3 . An up quark mass term has S\J{2)h 

QNs 3, 2 or 1 as for Qig, and a down quark mass term has SU(2)iii 
QNs (2 + 1) X 3 = 4 + 2 + 3. Hence, a Higgs held belonging to the 
representation 2 or 3 of SU( 2 )/i produces masses both for the up and 
down quark sectors. A singlet Higgs held under SU( 2 )j:i- generates 
a mass matrix only for the up sector, but it couples to the three 
families producing a rank three mass matrix and generating rrit, rUc 
and rriu at tree-level. Therefore Qg is discarded. 


Finally, the SU(3 )c©_SU(2)h(8)SU(2)l©U(1)y QNs for Qio are 
q ~ (3, 3, 2)1/3, u" ~ (3,3, l)_4/3, d'^ ~ 3(3,1, 1 ) 2 / 3 - Now an up 
quark mass term has SU( 2 )iii QNs 3x3 = 5 + 3 + l and a down 
quark mass term is a triplet under SU(2)iii. Thus a Higgs held 
belonging to the representation 3 of SU(2)iii will generate mass ma¬ 
trices for the up and down sectors at the same time, but a Higgs 
held in the representation 1 or 5 of SU(2)ii/ will produce tree-level 
masses only for the up sector. However the mass matrices gener¬ 
ated in both cases are rank three [pd]| , producing three-level masses 
for the three families. Therefore this possibility, the last one in the 
case without right handed neutrinos, is also discarded. 


When the right-handed neutrinos are included in the spectrum 
(one for each family), the number of models satisfying the anomaly 
constraints become 35 (see equation (35) in Ref.[|^). These 35 mod¬ 
els correspond to the 14 structures of the neutrinoless case with the 
three neutrinos accommodated in the representation 3 of SU(2)iii, 
plus the same 14 structures of the neutrinoless case with the three 
neutrinos accommodated in the representation 1 © 1 © 1 of 811(2)^^, 
plus seven more structures with the neutrinos accommodated in the 
representation (2+1) of SU(2)ji/, and the quark spectrum given by 
(Qi, Q3, Qs, Qs, Qi7, Qi9, and Q21). The structures Qi, Qs, and 
Q21 where analyzed and excluded in the previous paragraphs. Also 
Qs and Q17 are such that and d^ are in the same SU(2 )h repre¬ 
sentation, and in Q 19 SU( 2 )i 7 does not act on the up quark sector 
at all. We are thus left only with Q 3 to be analyzed here. 


The SU( 3 )c©SU( 2 )j 7 ©SU( 2 )i©U(l)Y QNs for the quark sector in 
Q 3 are q ~ (3, 3, 2 ) 1 / 3 , ~ (3, 3, l)_4/3, d'^ ~ (3, 2, l)2/3©(3,1, 1 ) 2 / 3 - 

An up quark mass term has SU( 2 )i 7 QNs 5,3,1 as in Qio, and a down 
quark mass term is of the form 3x(2 + l)~4 + 2 + 3. A Higgs held 
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belonging to representation 3 of SU(2 )h generates thus masses for 
the up and down quark sectors simultaneously. A Higgs held in a 1 
or 5 representation of SU{2)h generates a mass matrix only for the 
up quark sector, but of rank 3 O- Therefore Qs is also ruled out. 


The conclusion is that SU(3)c®SU(2)j:/®SU(2)2,®U(l)y can not 
explain why rrit » mj,. 


5 SU(3)e0SU(2)L0U(l)y«) SU(2)HL®SU(2)Hfl. 

Gauge anomaly cancellation is satished if the [SU(2)ii/2,]^U(l)y and 
[SU(2)i:/ij]^U(l)y anomalies vanish while global anomaly cancella¬ 
tion requires that there be an even number of SU(2)//2, and of 
S\J{2)hr doublets. Tables 3 and 4a show the values of the anoma¬ 
lies for the various possible ways of assigning representations to the 
particle types. 

Comparing the values from these tables, and without including 
right-handed neutrinos, only six theories satisfying gauge and global 
anomaly cancellation appear. They are: (Li-|-Qi, L3-I-Q4, L5-I-Q12, 
Le+Qii, L7-I-Q18, L9-I-Q21). The last of these models is just the 
SM and therefore 811(2)77^(8)811(2)77does not act upon it. Notice 
also from Table 4a that for the other hve quark structures Qi, Q4, 
Qii, Qi 2 and Qig (and also for Q21 if we wish) the up and down 
sectors belong to the same 811(2)7777 representation, and then, a 
Higgs held which produces a non-zero mass matrix for the up sector 
will produce a non-zero mass matrix for the down sector as well. 
Therefore, all of them are ruled out. 

When we include the three right-handed neutrinos we see that 
they do not contribute to the gauge anomaly (Ysm = 0 for z/f), 
and their contribution to the global anomaly will also be zero if 
the neutrinos transform either as three singlets or as a triplet under 
811(2)7777 (Ni and N3 respectively in what follows). Now, when they 
transform as a singlet plus a doublet (N2), they contribute with 
an extra doublet to the global anomaly. There are then a total of 
14 models without anomalies, the six structures of the neutrinoless 
case each one added with Ni or with N3, plus the following two new 
structures: (L4 -|- Qs + N2) and (Lg -|- Q17 -|- N2). The hrst 12 
models were already ruled out. 

The two new quark structures Qg and Q17 are also such that the 
up and down quark sectors belong to the same representation of 
811(2)7777 (2-1-1). Therefore they are also ruled out. Our conclusion 
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is that SU(3)c®SU(2)L(8)U(l)y(8) S\J{2)hl^S\J{2)hr is not able to 
explain why rrit >> mb- 


6 SU(3)c0SU(2)i0U(l)r0 SU(2)^i0SU(2)^2 


In section 3.4 it was shown that U(l)'^“'^(XiU(l)'^^ satishes our require¬ 
ments. We may then ask whether a different assignment of the r] 
fields to SU(2)/i-i and SU(2)j^2, other than separating left-handed 
fields from right-handed ones, would lead to a viable model. 


We start by looking for the representations content of the q, u 
and Higgs fields that give rise to a rank-one up-quark mass matrix. 
Let then = (1 -|- 1 -|- 1), (2-|-l), or 3 be the representation con¬ 
tent oit] = q OT u under some fixed SU(2)j7i group. There are nine 
possibilities for n = [ug, n^). Although the rank of the up quark 
mass matrices that are allowed in each case has been already dis¬ 
cussed in the previous section, we follow here a slightly different 
path in order to be able to leave unspecified the SU(2)ji^i group. It 
is straightforward to compute the rank of the up-quark mass matri¬ 
ces in each case but we can also read it from the tables IV and V 
of Ref. 1^. The results are listed in table 4b together with a Qj 


arrangement which contains the same (ug, Hu) entry and with the 
Higgs representations that leads to a non zero rank. 


After we discard from table 4b the cases with rank > 1, we are 
left with 8 {uq, n^) = ha arrangements. Given Ug and a down- 
quark mass term is forbidden if is not in the set of irreducible 
representations in the complete reduction of Ug x rid- Table 4c lists 
the above mentioned ua together with the values of which forbid a 
down-quark mass term and with the corresponding [SU(2)j:^i] "U(l)r 
anomalies. As we can see, all the cases are anomalous and we have to 
include some leptons in SU(2)j:^i. The contribution to the anomaly 
from ri; = (1 -|- 1 -|- 1-|-), 2-|-l, 3 is, however, = 0, -2, -8 while that of 
rig = (1 -|- 1 -f 1-I-), 2-1-1, 3 is 0, 2, 8 and that of = 0. Therefore 
it is impossible to cancel the anomalies listed in table 4c. and none 
of the SU(2 )//i®SU( 2)//2 models is viable. The same reasoning ap¬ 
plies to SU(2)//i®U(l)//i®SU(2)/f2<8U(2)ff2 or any other Gh such 
that SU(2 )j:^i®SU(2)ji/2 C Gh C G. For the sake of illustration and 
completeness we discuss in the following two sections two cases with 
other higher symmetry Gh groups. 
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7 SU(3)c0SU(2)i0U(l)y(g) SV{3)h. 


This model with quarks and leptons in the vectorlike 3 + 3 represen¬ 
tation of SU(3 )H was introduced for the first time in the literature 

In Ref.[|I^ 


in Ref.[|^ and analyzed later in Refs.|p.4||. In Ref.[|I^] the known 
quarks and leptons where assigned to the chiral 3+3 representa¬ 
tion of SU(3)/f canceling the anomalies with mirror fermions, and 
recently in Ref.|p. 6 ||, the anomalies in this last representation were 


canceled in a more general way. 


[SU(3)c, SU( 2 ) 2 ,] multiplets may belong to the 1 , 3 or 3 repre¬ 
sentation of SU(3)//. On the other hand, since SU(3) is not a real 
group, the cancellation of the [SU(3)//]^ and [SU(3)//]^U(l)y anoma¬ 
lies is nontrivial; in particular the cancellation of the hrst anomaly is 
achieved only when the number of SU(3 )h triplets equals the num¬ 
ber of antitriplets. Finally, since there are 18 different quark helds 
(36 Weyl states) but only 6 different lepton helds (12 or 9 Weyl 
states depending on whether we include or not the right-handed 
neutrino states), then it is not always possible to cancel the quark 
anomalies with the lepton anomalies. 


In Table 5 we include all the possible SU(3)/f fermion held repre¬ 
sentation assignments which are free of the SU(3 )h gauge anomalies, 
together with their [SU(3)/f]^U(l)y anomaly value. From this table 
we hnd that only the models M 3 , M 4 , Mg, M 13 , M 14 , M 17 , Mig, and 
Mi 9 , are safe. (Notice that without right-handed neutrino states, the 
only anomaly free model is M 4 and that for M 13 and M 14 SU( 3 )i 7 
does not act on the left-handed helds at all). M 19 , M 3 and Mg are 
not adequate candidates since M 19 is just the SM, SU(3 )h does not 
act on the quark sector of M 3 , and S\J{3)h does not act on the up 
quark sector of Mg. 

In M 4 , a mass term for the up sector has SU(3 )h QNs 3x3 = 8+1, 
and a mass term for the down sector has the same SU(3 )h QNs. 
Since both representations 8 and 1 are real, a Higgs held 0 which 
produces a mass matrix for the up quark sector will also produce a 
down quark mass matrix via ia 2 L(p*- This argument is also valid for 
Mi 7 and Mig (see Refs. [pT^, H^)- Therefore M 4 , M 17 and Mig can 
not explain why nib « mt- 


Now, for Mi 3 and M 14 a Higgs held <p' able to produce a mass term 
for the up sector must be in the representation 3 of S\J{3)h- 

But such a Higgs held automatically produces a down quark mass 

term (0 ^d'^q via 0 = icr 2 L 0 '*. Thus again we conclude that SU( 3)77 
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by itself can not explain why mb « mt- 


8 SU(3),®SU(2)i0U(l)y® SU(3 )hl®SU(3)hr. 

Since S\J{3)hl would act only on g* and /*, the S\J{3)hl safe repre¬ 
sentations are only those for which the anomalies in the quark sector 
cancel exactly the anomalies in the lepton sector, which is impossible 
when q and/or / are in a nontrivial representation (3 or 3) due to the 
fact that in this case there would be six SU(3 )l representations in q 
(due to color) while only two in /. Therefore S\J{3)hl^S\J{3)hr is 
equivalent to a single SU(3)/f which accommodates the left-handed 
helds Qi and li in the representation l-l-l-l-l. This information can 
be extracted from Table 5 identifying SU( 3 )j 7 as SU( 3 )j 7 /j. 

From Table 5 we read that when g* and U are in the representation 
l-l-l-l-l of SU(3 )hl only M 13 and M 14 are anomaly free. But those 
two models are also ruled out by the same reason that they were 
ruled out in the previous section. Hence SU(3)c®SU(2)i(8)U(l)y® 
SU( 3 )j 7 L®SU( 3 )Hi? by itself can not explain why mb « mt- 

9 Brief analysis of MI and Mil models. 

In the previous sections we have analyzed all the possible horizontal 
gauge models able to accommodate three families. From them we 
selected those models able to generate a rank one tree-level mass 
matrix for the up quark sector and a rank zero tree-level mass matrix 
for the down quark sector. We have found only two candidates 
named MI and Mil, both of them with the horizontal structure 
U(l)/f or 

Table Ib depicts explicitly the U(l)// (or U(1)'?“®®U(1)'^^) hyper¬ 
charges of fermions in these models. These hypercharges are then 
responsible for the quantum numbers of all possible (mass generat¬ 
ing) Yukawa terms displayed in Appendix B. As can be seen, only 
one Yukawa term has zero horizontal hypercharge, 

MI: 

Mil; 

In what follows we briefly comment on some aspects of these 
models. 
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9.1 The symmetry breaking chain. 

For simplicity, let us introduce two Higgs fields (I)h and (j)sM, both 
of them developing vacuum expectation values. (0^) ~ Mh and 
{4>sm) Mz, such that 

SU{3), (8) SU{2)l ® U{1)y ®Gh^ SU{3), ® SU{2)l ® U{1)y 

^SU{3),®U{1)q, 

where Gh = U(1)h or and where Q = T^l + Y/2. 

The SU(3)c(8)SU(2)i®U(l)y®U(l)H QNs for (pn and (jysM are 
(1,1, 0, ±(35'+ 5)/2) and (1, 2, —1, ±25') respectively, where the 
U(l)/f hypercharges are chosen for further purposes, and the up¬ 
per and down signs are related to MI and Mil respectively. 

The required Higgs system in this section is minimal in the sense 
that there is a Higgs SU(2)i doublet associated with the SM mass 
scale, and a singlet which provides the desired mass of the U(l)// 
gauge boson Z', heavy enough to avoid conflict with experiments. 

9.2 Bottom quark mass. 

To generate a bottom quark mass matrix different from zero in MI 
or MH further ingredients must be added to the models. For this 
purposes we introduce two new Higgs fields0*'^^ and which 
do not develop VEVs and with QNs given by 1, -2/3, ±25') 

and 1, 2/3, ±(5 ± 5')). With these new Higgs fields other 

Yukawa terms are allowed in the Lagrangian, 

G = ± ± h.c., 

where uaL is the SU(2)i metric, hi and ha are Yukawa coupling 
constants, and a, /?, and 7 are SU(3)c indices. Then there will be 
a one loop level contribution to a rank one finite, down quark mass 
matrix. In this loop the top quark mass will act as a seed and the 
loop will be completed with the propagators of the and 0*'^^ 
fields mixed at tree-level by a term of the form 

9.3 Consistence with experimental constraints. 

In MI and MH flavor changing neutral currents (FCNC) are medi¬ 
ated by the new gauge boson 2’'[|, Q and by the Higgs fields 0^, 0*^^^ 
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and 0^^^. The FCNCs resulting from Z' can be suppressed by giving 
the new gauge boson a mass equal to or larger than 100 TeVs. 

The FCNCs resulting from Higgs couplings can also be sup¬ 
pressed by giving the Higgs bosons sufficiently large masses. Naively, 
a mass of 100 TeVs for each one of those scalar helds will be con¬ 
sistent with the experimental constraints. Since the scalar sector 
introduced up to this point serves only as a starting point for more 
realistic mass generation schemes, we will not pursue any detailed 
Higgs phenomenology in the present paper. 


9.4 Masses for the other fermions and Mixing angles. 


Another concern of horizontal models of this kind is how to generate 
the radiative corrections that are assumed to provide the smaller 
masses and mixing angles in the models. For this purposes the 
cascade mechanism may be invoked. In this mechanism the light 
particles gain masses at various orders of perturbation theory from 
masses induced at the previous order of approximation. This mech¬ 
anism requires the introduction of new scalars and is presented in 


detail in Refs.[17, 18 


An interesting feature of a particular version of the cascade mechanism |T7 
is that it couples the up quark to the strange and bottom quarks 
and couples the down quark to the charm and top quarks through 
the higher order corrections, thus providing a natural explanation 
for the observation m„ <md. 


9.5 Embedding in a higher symmetry model. 

In the two models under consideration the traces of the horizon¬ 
tal hypercharges vanish in the family basis. Therefore U(l)i^ or 
U(i)'J“®(giU(l)‘^^ can be embedded into a simple or semisimple group. 
Rescaling the H hypercharges we can write the generators as 

Ts = diag{l,Q, -1) 

or as 

(l/2)A3 = dm(7(l/2,-1/2,0) 

corresponding to (one of) the diagonal generators of an SU(2)j:/ or an 
SU(3)i^ group. The higher symmetry horizontal group can then be 
SU(2)j^, SU(2)'?“^®SU(2)'^', S\J{3)h, or SU(3)^“"®SU(3)‘^h In any 
of these cases the model should contain additional features, such 
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as extra fermions, in order to avoid the constraints that lead us to 
discard them. 


10 Conclusion 

The requirement of anomaly cancellation for the SM augmented with 
a horizontal factor, and with no additional fermions, other than right 
handed neutrinos, constitutes an strong condition. Without forcing 
by hand the orientation of the vacuum, the set of the viable Gh, 
groups is limited to U(l)// and U(l)i^i®U(l)iif 2 - In each case two 
models have been found with the fermions having the horizontal 
hypercharges displayed in table lb. 

11 Acknowledgements 

This work was partially supported by CONACyT in Mexico and 
COLCIENCIAS in Colombia. One of us (A.Z) acknowledges the 
hospitality of Prof. J. Bernabeu and of the Theory Group at the 
University of Valencia as well as the financial support of Direccion 
General de Investigacion Cientihca y Tecnica (DGICYT) of the Min¬ 
istry of Education and Science of Spain and the hospitality and fi¬ 
nancial support of the Institute of Nuclear Theory in Seattle during 
part of the summer. 


16 



APPENDIX A. Irrational and complex solutions 
to the anomaly constraints 


In this appendix we present a new set of solutions to the anomaly 
constraint equations for the gauge group SU(3)c(8)SU(2)i®U(l)y®U(l)j:/, 
for the case when the anomalies are canceled by an interplay among 
families. We look for solutions to Eqs. 1 to 6 where a sum over 
i = 1,2,3 should be understood as indicated in section 2.2, and 
again we restrict to the case where = 0. We classify this 

new set of solutions in the following classes: 

CLASS A With Yui=Ydi=Yqi = 0; i = 1, 2, 3 
The constraint equations are now 

i=l i=l 


i=l i=l 

'tyi ^-'2'tYi =-3b (Al) 

i=l i=l 

where a and b are arbitrary numbers. This class and class A of 
section 2 overlap when b= 0, a = S' = 0. 

The roots of the cubic equation 

Y^-aY + b = 0 


satisfy eqs. ^T| and their ratios are irrational or complex numbers 
for b 7 ^ 0. 


Other classes are given by: 

CLASS B' With Yei=Yui=Ydi=0; i=l,2,3 


CLASS C^ With ¥^^=¥^*=¥^*=0; i=l,2,3, etc. 

The exotic solutions presented in this Appendix are not consid¬ 
ered in the main text because we do not envisage how to fit them 
in a natural way into more general theories. 
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APPENDIX B. Horizontal quantum numbers of 
Yukawa terms in the MI and Mil Models. 

I). MI model. 


£( 2 / 3 ) ^ 



0 

-25' 

-5' 

-25' 

-45' 

-35' 

-5' 

-35' 

-25' 


^(-1/3) ^ 



( S + 3S' S + S' S + 2S' \ 
-S + 3S' -S + S' -S + 2S' 

\ 35' 5' 25' ) 


£(-i) 




z/ 

e 


/ 5 + 35' -5 + 35' 35' \ 
5 + 5' -5 + 5' 5' 

V 5 + 25' -5 + 25' 25' J 


£(°( = 0 ^ 



Y,, = 5 , : 

Y^i = 0: 


[ 25 - 25' -25' 5-25' \ 

-25' -25 - 25' -5-25' 

\ 5-25' -5-25' -25' ) 

(5-25' -5- 25' -25' \ 

5-25' -5-25' -25' 

V 5 - 25' -5 - 25' -25' J 


II). Mil model. 




/ 45' 25' 35' \ 
25' 0 5' 

V 35' 5' 25' J 


^(-1/3) ^ 


U 

d 


/ 5-5' 5-35' 5-25' \ 

-5-5' -5-35' -5-25' 

V -5' -35' -25' ) 
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(5-5' 

1 

1 

-5' 

5-35' 

-5 - 35' 

-35' 

V A 

{5-25' 

-5 - 25' 

-25' 




Y ■ = 8- ■ 

^ VI • 


< 


= 0 ; 


( 25 + 25' 25' 5 + 25' 

25' -25 + 25' -5 + 25' 

V 5 + 25' -5 + 25' 25' 

[5 + 25' -5 + 25' 25' \ 

5 + 25' -5 + 25' 25' 

\5 + 25' -5 + 25' 25' ) 


Here, as well as in the main text, the contraction of spinor indices 
should be understood taking into account the charge conjugation 
matrix C, 


u^q^ufCqL, C = i727o. 
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Table la. U(l)y, U(1 )h, U(1)^ and U(l)^ charges for the known 
fermions, i = 1, 2, 3 is a flavor index denoting hrst, second and third 
family respectively. The Ysm valnes stated are family independent. 
All fermions are left handed. 



k = (z/, e)i 


Qi = (n,d)i 


d1 


Ysm 

-1 

2 

1/3 

-4/3 

2/3 

0 

Yh 

Yu 

Y 

et 

Y,. 

Y 

Ul 

Yd^ 

Y 

m 

YL 

YL 
^ li 

0 

Y^. 

0 

0 

0 

yr 

0 

yr 

ei 

0 

yr 

ui 

V-^ 

^ di 

yr 

^ vi 


Table lb. U(l)y and U(1)^“‘^®U(1)'^^ [or U(l)// with Yh = + 

charges, as 3 x 3 diagonal matrices in the family basis, for 
the known fermions in MI and Mil models. The Ysm matrices are 
proportional to the 3x3 nnit matrix. 



U(l)<?«e 

U(i)dz 

Qi = (m, d)i u1 e- 

k = (z/, e)i dl z// 

Ysm 

■ydl 

Yh 

1/3 -4/3 2 

(Y, -Y, 0) (Y, -Y, 0) (Y, -Y, 0) 

0 0 0 

(Y, -Y, 0) (Y, -Y, 0) (Y, -Y, 0) 

-1 2/3 0 

0 0 0 

{S, -S, 0) {6, -S, 0) {S, -6, 0) or 0 

{6, -S, 0) {6, -6, 0) {S, -6, 0) or 0 
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Table 2. Summary of tree-level mass terms for all the possible mod¬ 
els with SU(3)c®SU(2)i,(8)U(l)y®U(l)/i- symmetry group allowed 
by the indicated Higgs held hypercharge 


Y<^ 

CLASS A 

CLASS B 

CLASS C 

26' 

-26' 

0 

6' 

-6' 

6 + 6' 

-6 + 6' 
6-6' 
-6-6' 

6 

-6 

(l,lk(2,2), 

(2,2K;(1,1), 

(1,2),;(2,1)„(3,3),;(1,2),; (2,1),; (3,3), 

(1.3) ,; (3,1),; (2, 3),; (3,2), 

(2.3) ,;(3, 2),; (1,3),; (3,1), 

(3, 3),; (3, 3), 

(3.1) .;(3,2), 
(3, 2),;(3,1), 

(1.1) .;(2,2), 
(2,!).;(!,2), 
(1,2).; (2,1), 
(2,2),;(1,1), 
(1,3).; (2,3), 
(2, 3),;(1,3), 

(1,1). 

(2,2), 

(1,2),; (2,1),; (3, 3),; (3,3), 

(1.3) ,; (3,1),; (2, 3), 

(2.3) ,; (3, 2),; (1,3), 

(2,2), 

(2.1) d 

(1.2) d 

(1.1) rf 

(3.1) d 

(3.2) , 
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Table 3. Possible lepton 811(2)^^2,0811(2)^/? representation assign¬ 
ments, and their anomalies. [HL(R)]^Y stands for [8U(2)22L(2j)]^U(l)y 
The representation for refers to the 811(2)222, group and the rep¬ 
resentation for el refers to the 8U(2)222? group. 



k 


[HLj^Y. 

anomaly 

[HRj^Y. 

anomaly 

2 '^ 


hi 

3 

3 

-8 

8 

0 

0 

L2 

3 

2+1 

-8 

2 

0 

1 

L3 

2+1 

3 

-2 

8 

2 

0 

L4 

2+1 

2+1 

-2 

2 

2 

1 

L5 

3 

1+1+1 

-8 

0 

0 

0 

he 

1+1+1 

3 

0 

8 

0 

0 

L? 

2+1 

1+1+1 

-2 

0 

2 

0 

Lg 

1+1+1 

2+1 

0 

2 

0 

1 

Lg 

1+1+1 

1+1+1 

0 

0 

0 

0 
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Table 4a. Possible quark SU(2)iifL®SU(2)iif/{ representation assign¬ 
ments, and their anomalies. [HL(R)]^Y stands for [SU(2)j7L(ii;)]^U(l)y 
The representation for g* refers to the SU(2)//2, group and the rep¬ 
resentation for u1 and refers to the S\J{2)hji group. 


■ 

qi 

ul 

d1 

[HL]2Y 

anomaly 

[HRj^Y 

anomaly 



Qi 

3 

3 

3 

8 

-8 

0 

0 

Q2 

3 

2+1 

3 

8 

4 

0 

3 

Qs 

3 

3 

2+1 

8 

-14 

0 

3 

Q4 

2+1 

3 

3 

2 

-8 

6 

0 

Q5 

3 

2+1 

2+1 

8 

-2 

0 

6 

Qe 

2+1 

2+1 

3 

2 

4 

6 

3 

Q? 

2+1 

3 

2+1 

2 

-14 

6 

3 

Qs 

2+1 

2+1 

2+1 

2 

-2 

6 

6 

Qg 

3 

1+1+1 

3 

8 

8 

0 

0 

Qio 

3 

3 

1+1+1 

8 

-16 

0 

0 

Qii 

1 + 1+1 

3 

3 

0 

-8 

0 

0 

Qi2 

3 

1+1+1 

1+1+1 

8 

0 

0 

0 

Qi3 

1 + 1+1 

1+1+1 

3 

0 

8 

0 

0 

Qi4 

1 + 1+1 

3 

1+1+1 

0 

-16 

0 

0 

Qi5 

2+1 

1+1+1 

2+1 

2 

2 

6 

3 

Qi6 

2+1 

2+1 

1+1+1 

2 

-4 

6 

3 

Qi7 

1 + 1+1 

2+1 

2+1 

0 

-2 

0 

6 

Qi8 

2+1 

1+1+1 

1+1+1 

2 

0 

6 

0 

Qi9 

1 + 1+1 

1+1+1 

2+1 

0 

2 

0 

3 

Q20 

1 + 1+1 

2+1 

1+1+1 

0 

-4 

0 

3 

Q2I 

1 + 1+1 

1+1+1 

1+1+1 

0 

0 

0 

0 

Q22 

3 

2+1 

1+1+1 

8 

-4 

0 

3 

Q23 

3 

1+1+1 

2+1 

8 

2 

0 

3 

Q24 

2+1 

3 

1+1+1 

2 

-16 

6 

0 

Q25 

2+1 

1+1+1 

3 

2 

8 

6 

0 

Q26 

1 + 1+1 

3 

2+1 

0 

-14 

0 

3 

Q27 

1 + 1+1 

2+1 

3 

0 

4 

0 

3 
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Table 4b. Rank of the up-quark mass matrix for the different rep¬ 
resentation contents of q, u and 0 under some SU(2)//i group. Qj 
is one of the quark arrangements with the same Uq and content 
which helps in hnding the corresponding case in tables IV and V of 
Ref. 0. 


Uq 

nu 

Q* 


rank 

1 + 1 + 1 

1+1+1 

Q21 

1 

3 

1 + 1 + 1 

2+1 

Qi7 

1 

1 




2 

1 

1 + 1 + 1 

3 

Qii 

3 

1 

2+1 

1+1+1 

Qi8 

1 

1 
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1 

2+1 

2+1 

Qe 

1 

3 




2 

2 
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2 
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Table 4c. Quark and Higgs SU(2 )hi representations with a rank-one 
up-quark mass matrix and with simultaneous rank-zero down-quark 
mass matrix and the corresponding [SU(2)j:/i]^ U(l)y anomaly. 
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Table 5. Possible quark and lepton SU(3 )h representations which 
are free of the gauge SU(3 )h anomaly, where a 1 value stands for 
1 + 1 + 1. [3H]^Y stands for the [SU(3)//]^U(l)y anomaly value. 
The number of representations can be doubled by the replacement 
3 <->■ 3, but the new 18 arrangements are equivalent to the present 
ones (as far as the low energy phenomenology is concerned). 
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